Exploiting Model Equivalences for Solving Interactive Dynamic Influence Diagrams

Exploiting Model Equivalences for Solving Interactive Dynamic Influence Diagrams

We focus on the problem of sequential decision making in partially observable environments shared with other agents of uncertain types having similar or conflicting objectives. This problem has been previously formalized by multiple frameworks one of which is the interactive dynamic influence diagram (I-DID), which generalizes the well-known influence diagram to the multiagent setting. I-DIDs a...

A Value Equivalence Approach for Solving Interactive Dynamic Influence Diagrams

Interactive dynamic influence diagrams (I-DIDs) are recognized graphical models for sequential multiagent decision making under uncertainty. They represent the problem of how a subject agent acts in a common setting shared with other agents who may act in sophisticated ways. The difficulty in solving I-DIDs is mainly due to an exponentially growing space of candidate models ascribed to other ag...

Approximate Solutions of Interactive Dynamic Influence Diagrams Using Model Clustering

Interactive dynamic influence diagrams (I-DIDs) offer a transparent and semantically clear representation for the sequential decision-making problem over multiple time steps in the presence of other interacting agents. Solving I-DIDs exactly involves knowing the solutions of possible models of the other agents, which increase exponentially with the number of time steps. We present a method of s...

ǫ-Subjective Equivalence of Models for Interactive Dynamic Influence Diagrams

Interactive dynamic influence diagrams (I-DID) are graphical models for sequential decision making in uncertain settings shared by other agents. Algorithms for solving I-DIDs face the challenge of an exponentially growing space of candidate models ascribed to other agents, over time. Pruning behaviorally equivalent models is one way toward minimizing the model set. We seek to further reduce the...

Learning Agents' Relations in Interactive Multiagent Dynamic Influence Diagrams